LECTURE NOTES: THE GALERKIN METHOD 



Raghavendra Venkatraman 

In these notes, we consider the analysis of Galerkin Method and its apphca- 
tion to computing approximate solutions of integral equations. The emphasis is on 
Galerkin methods with an orthogonal basis. We introduce the Galerkin method in 
the framework of a Hilbert space. We give a computational example that illustrates 
the importance of choosing the right basis for the approximating finite dimensional 
subspaces. We then consider the solution of an integral equation whose exact so- 
lution is known, and present a sample matlab code to illustrate the success of the 
method. Finally, we give an interesting proof for how the Galerkin Method can be 
use to study the existence of solutions to a nonlinear boundary value problem based 
on its variational formulation. 

1. Warming up: Some Analysis, Geometry and Hand Calculations 

In this section, we motivate the Galerkin Method from analysis, and give some 
geometrical intuition for the case of symmetric problems. We subsequently pass on 
to a simple example, that illustrates the importance of choosing a good basis with 
the help of a numerical example. Most of the material of this section is based on 
the Numerical Analysis book by K. Atkinson jlj. 

We begin by introducing a Hilbert Space V, and a bihnear form a(-,-) : V x V 
which is both bounded and elliptic, that is. 

Definition 1 (Boundedness of Bilinear Form). The form a(-, •) is bounded if there 
exists a positive number M > such that 

|a(M, w)| < yllullv Vu, w € y, 

and 

Definition 2 ( V-EUipticity) . The form a(-,-) is V— elliptic provided there exists 
a constant a such that 

a{v,v) > a\\v\\y G V. 

Now, the basic problem of interest is the following: Given a functional I G V' , 
(the dual space of V,) we look to find u E V for which 

(1) aiu,v)^l{v) yveV. 

The Lax-Milgram Lemma p] |T] gaurantees the existence of a unique solution u to 
the problem H]). In case of partial differential or integral equations, the space V is 
infinite dimensional, hence it is rarely possible to find an exact solution to problem 
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In order to construct an approximate solution, it is natural to consider a finite 
dimensional approximation to ([T]). For instance, we consider the finite dimensional 
subspace Vn C V, an A^— dimensional subspace of the space V, and project the 
problem ([T]) onto Vn, that is, we seek for 

(2) Mat e Vat, a{uN,v) = l{v), Vw € V}v, 

and hope that the resulting sequence of approximate solutions converges in some 
sense to the solution of the original problem. Since a(-, •) is bounded and V— elliptic 
as before, Lax-Milgram grants the existence of a unique solution ujv G Vjv for I eV. 
We rewrite ([2]) as a linear system as follows. Supposing be a basis of the 

finite dimensional subspace Vat, we write, 

N 

UN = X^^J'^J' 

i=i 

and take v £ Vn to be the basis functions (f>i . Accordingly, we get the linear system 

(3) = b, 

where ^ E is the unknown vector, [A]ij — [a{(j)i, <j>j)] G (motivated from 

mechanics) is termed the stiffness matrix and b = € the loading vector. 

The approximate solution un differs from the exact solution u, to increase the 
accuracy of the solution, we look for solutions in larger finite dimensional subspaces. 
Accordingly, corresponding to a sequence of subspaces Vi C V2 C • • • C V^, dim Vj < 
00, j — 1, 2, • • • , we compute the approximate solutions Ui G Vi,i — 1,2,-- - , this 
solution procedure generates the so-called Galerkin Method. We now consider the 
special case when a(u, v) is symmetric, that is, 

a{u, v) = a{v, u) Vu, v eV. 

In this case, it can be checked readily that the ([T]) is equivalent to the folowing 
minimization programme, 

(4) ueV, E{u) = inf E{v), E{v) = ]-a{v, v) ~ l{v). 

vev 2 

Correspondingly, the approximate problem ([2]) can be viewed as a minimization 
programme over the finite dimensional subspace Vn of V, 

(5) Seek un G Vn, E{un) = inf E{v). 

vGVn 

Before proceeding, we consider the following example. 

Example 1. Consider the two point boundary value problem, 

-u" = /in(0,l), 
^> w(0) = m(1) = 0. 

The weak formulation of the problem, is 

(7) Seek ueV, [ uv' dx ^ [ fv dx Vw G V, 

Jo Jo 

where V — Hq{0,1). Accordingly, Lax-Milgram grants the existance of a unique 
solution. To develop a Galerkin method, we identify a finite dimensional subspace of 
basis functions that satisfy the boundary conditions at a; = 0, 1. A natural choice for 
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the subspace is to consider one whose basis vectors satisfy the boundary conditions 
of the bvp: 

Vat = span {a;''(l - a;)|i = 1,2,- • -iV}. 

Approximating, 

JV 

UN = ~ x); 

where the coefficients are determined by the Galerkin equations 

■I'jyv' dx = / fvdx Vti G Vjv. 

Jo 

Taking v to be each of the basis functions — < i < N, we obtain the 
following linear system of equations, 

where ^ — ^2, • ' ' An)'^ is the vector of unknowns, b G is the vector whose 
i-th component is /(x)a;*(l — x) dx. The coefficient matrix A, has (z, j)th entry 
given by. 

The coefficient matrix is fairly ill-conditioned, and as a matter of fact, using the 
cond(X, p) command of matlab, it is fairly easy to calculate the condition numbers 
of the matrices A, for instance in 2— norm, 

N ConditionNumber[A) 
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891.6637 


4 


2.4233e + 04 


5 


6.5617e + 05 


6 


1.7919e + 07 


7 


4.9532e + 08 


8 


1.3867e+10 


9 


3.9288e+ 11 


10 


1.1282e+ 13 



We now work out the previous problem now using a different finite dimensional 
subspace, 

V/v = span{shi{iTTx)\i = 1, • • • ,iV}. 

The basis functions are orthogonal with respect to the inner product defined by the 
bilinear form, 

(sin j7ra;)'(sinz7ra;)' da; — Sij . 
Jo 2 
Again, writing 

N 

UN = ^(.j sinjTTx, 

the coefficients satisfy the following linear system, which is in fact diagonal, 
hence we get the solution, 

2 

£,i = „ „ / f(x)smiTTxdx, i = l---N. 
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In fact, the Galerkin solution can be written in the form of a Kernel Approximation, 

UN ^ f{t)KN{x,t) dt, 



where the kernel function 



N 



KNix,t) = -J2 



2 ■r-^ sinjiTX ■ sin jnt 



Remark 1. The above examples clearly illustrate that it is very important to 
choose appropriate basis functions to the finite dimensional subspaces. 

Remark 2. The Galerkin Method is not just a numerical scheme for approximating 
solutions to a differential or integral equations. By passing to the limit, we can even 
prove some existence results. This point will be illustrated via a simple nonlinear 
example towards the end of the lecture. 

We now prove a result that serves as the basis for proving error estimates and 
convergence. 

Proposition 1 (Cea Inequality). Let V a Hilbert Space, Vn C V is a subspace, 
a(-, •) is a bounded and V— elliptic bilinear form on V, and I £ V . Let u V be the 
solution of the problem ([T]), and mat G Vn be the Galerkin Approximation defined 
in ([2|). Then 

(8) — UAr||y<C inf — 

Proof. Subtracting ^ and (H]) with v G Vn, we obtain the orthogonality relation, 

(9) a{u — UN,v) — 0, \fvEVN- 

Accordingly, using V— ellipticity, and boundedness of a, we have for any v G Vn, 

a\\u — UN\\y < a{u — un,u — un) 

(10) ~a{u — UN,u~v) 

< M\\u-un\\v\\u~v\\v 

Accordingly, 

11m - un\\v < c\\u ~ v\\v, 
since v S Vn is arbitrary, the inequality follows. □ 

We have the following convergence result as a consequence of the Cea Inequality, 

Corollary 1 (Convergence). Making the assumptions stated m[Il Assume Vi C 
V2 C • • • is a sequence of finite dimensional subspaces of V with the property 



(11) {jVn^V 

n>l 

Then the Galerkin method converges, 

(12) \\u-un\\v^O 
where un & Vn is the Galerkin Solution. 
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2. The Galerkin Method applied to Integral Equations 
We begin with the linear integral equation, 

(13) \u{x)~- / k{x,y)u{y)dy ^ f{x), x £ fl, 



where we usually seek solutions living in atleast a complete function space V. If Un 
is an approximate solution living in a finite dimensional subspace of V, we define 
the residual in the approximation by 

Definition 3 (Residual). 

(14) r„ = (A - K)un - f. 

Accordingly, we consider V — L^{il), a Hilbert Space, and denote by (•,•) its 
inner product. In the Galerkin methods, we require r„ to satisfy 

(15) {rn,(f)i) = 0, i = 1,2, •••«;„, 

where k„ is the dimension of the approximating subspace of y = L^(f2). Notice 
that the left hand side of (|15p is the Fourier coefficient r„ associated with the basis 
functions (jn- In particular, when y is a separable Hilbert space, and {4>i, • • • , ^k} 
consists of the leading members of the orthonormal family $ = {4>i}i>i which spans 
V. This implies that demands that the leading terms in the Fourier expansion 
of r„ with respect to vanish. To find m„, we use the above approximation in 
conjunction with the equation (A — K)u = f. We obtain the linear system 

(16) ^c,[A((/.j,0O-(if</'j,0z)] = (/,0z), i = l, •••,«„. 

This so-called Galerkin method with orthogonal basis raises an important question: 
When does the resulting sequence of approximate solutions u„ G Vn converge to 
u in V? We postpone the proof of this question to a specific nonlinear boundary 
value problem to the next section. For the moment, we consider some numerical 
examples, to make it evident that the method indeed works! 

2.1. A Galerkin Method with Trigonometric Polynomials. We consider the 
problem of solving the integral equation 

(17) Xu{x) - / k{x, y)u{y) dy = f{x), < x < 27r, 

with k{x^ y) and f{x) being 2n— periodic functions. We work within the framework 
of the Hilbert space V = L^{0, 27r). The inner product is given by, 

{u,v) — / u{x)v{x)dx. 
Jq 

We use as basis the functions 

0,(x)=e^^^ i = 0,±l,±2,... ,±n. 

The orthogonal projection of L^{0, 2tt) onto Vn is just the n— th partial sum of the 
series, 

1 " 

(18) P„u(a;) = — ^ (7.,0,)0,(x). 

j=-n 
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With respect to the basis (jij defined above, the linear system for 

(A - PnK)u„ = P„f, 

is given by 
(19) 

j^_„ ^0 Jo Jo 
It can be checked that the solution w„ is given by 



2ir /.27r r^Ti 

e^"^'-^ f{x)dx, K = -n - ■ -n. 



The integrals above are evaluated numerically, as the following numerical example 
shows, with slightly different orthonormal basis functions, namely orthonormal box 
functions. 

Example 2. We consider the first kind Fredhom Equation (the problem has been 
borrowed from p. 109 of [3]) 

(20) g{x)^ f\e--y"f{y)dy 

Jo 

where / is the unknown function, and g{x) depends on the two parameters yi, 2/2; 2/i < 
2/2, is given as 

' ' I 5(2/2 -yi), x^O. 

By direct substitution, it is easy to check that the solution is given by 

(22) f(v) - 1 ^' y^<y<y^ 

^ > JW)- <^ 0, all other 2;. 

We provide a simple matlab code to obtain a Galerkin Approximation to the solu- 
tion: 

function [A,b,x] = wing(n,tl ,t2) 

7o WING Test problem with a discontinuous solution. 
7. 

7. [A,b,x] = wing(n,tl,t2) 
7. 

7o Discretization of a first kind Fredholm integral eqaution with 
7o kernel K and right-hand side g given by 

7. K(s,t) = t*exp(-s*t"2) < s,t < 1 

7. g(s) = (exp(-s*tl"2) - exp(-s*t2~2)/(2*s) < s < 1 

7o and with the solution f given by 

7. f(t) = I 1 for tl < t < t2 

7t I elsewhere . 

% 

7o Here, tl and t2 are constants satisfying tl < t2. If they are 
7o not speficied, the values tl = 1/3 and t2 = 2/3 are used. 



7o Reference: G. M. Wing, "A Primer on Integral Equations of the 
7. First Kind", SIAM, 1991; p. 109. 
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7o Discretized by Galerkin method with orthonormal box functions; 
7o both integrations are done by the midpoint rule. 



7, Initialization, 
if (nargin==l) 

tl = 1/3; t2 = 2/3; 
else 

if (tl > t2) , errorC'tl must be smaller than t2'), end 
end 

A = zeros(n,n); h = 1/n; 

7o Set up matrix, 
sti = ((l:n)-0.5)*h; 
for i=l:n 

A(i,:) = h*sti .*exp(-sti(i)*sti. ~2) ; 
end 

7o Set up right-hand side, 
if (nargout > 1) 

b = sqrt(h)*0.5*(exp(-sti*tl~2) ' - exp(-sti*t2'2) ') ./sti' ; 
end 



7o Set up solution, 
if (nargout==3) 

1 = findCtl < sti & sti < t2) ; 

X = zeros(n,l); x(l) = sqrt (h) *ones (length(l) , 1) ; 
end 

3. A Nonlinear Example 

In this section, we wish to approximate the solutions to the nonhnear bvp, pass 
to the hmit and discuss the existence of its solutions. Let C ]R",n < 4 be a 
bounded open set. We need to discuss existence of weak solutions u G Hq{Q) of the 
problem, 

, , -Au - \u + u^ = f, in 

^ ' u = 0, on r. 

where / G L^(fi) and A e M. Notice that if u G H^{fl), by Sobolev Inclusion 
Theorem, u E L*{il), and 



U-^v\ < 1^10.4,01-^10,4,0 < C'll"lll,sJw||l,I2- 

In 

for V € i?o(ri). Hence E H^^{il). Accordingly, the weak formulation of the 
problem (|23|) will be to find u E i?o(f^) such that 

(24) Vu-Vv- X UV+ u^v = / fv, 

for every v E i/p (17). Since HQ{^l) is a separable Hilbert Space, let {wi,W2, • • • } be 
an orthonormal basis for this space. Define 

Wjn = span{wi,W2, • • • Wm}- 
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We now proceed in steps. 

Step 1: We look for Um G Wm such that 



n 







/ U.nV + 


/ = / 


In 


Jo Jo 



(25) / Vu„ • - A / u^-y + / u*^v ^ fv, veW, 



It suffices now if ([25|) is verified for w = Wi, I < « < m. Let ^ G M™, to each such ^ 
we associate a unique v G Wm by the map 



(26) v = Y.^ 



iWi. 

1 



This map is a hnear bijection between M™ and Wm, and more importantly, since 
the basis {wi} are orthonormal in HQ{fl) 

(27) biio = \e- 

Remark that 11^(^1) is equipped with the norm | • |i Define now, F : M'" M'", 

by 





' / f ^Wi - 


/ 


In 


Jo 


Jo 



where v is as given in ([^5]) . Now has a solution if there exists a ^ such that 
F[Cl = 0. Now, 

(28) =l^l?,n-Abl^,o + /o^'-/o/^ 

> l^'l?,n-^l«lo,o- l/lo,oklo,o. 

At this stage, in order to proceed, we need to make some restriction on A. Now 
from a course on PDE and functional analysis [2], we recall that the eigenvalues 
of the Dirichlet Problem of the Laplace operator are characterized in terms of the 
Rayleigh Quotient 

^^^^ = 

In particular, 

\v\ln < ^Hln- 

Hence we have, 

(29) (F(e),o > fi-^) 



Ai/'' VAT 

Provided that A < Ai, we can choose |^| = R large enough so that 

iFiO,0>0 for|e|=i?. 
Hence, by Brouwers Fixed Point Theorem, 3^'" such that, 

\r\<R, F(r) = o. 

At this stage, we set — J27Li ^T'^i ^^'^ G Wm will be a solution to ([50)) . 
Furthermore, (l?f)) implies that 

|Um|l,0 < R, 

with R depending only on A, /. 

Step 2: Since {um} is uniformly bounded in Hq{U), Arzela Ascoli allows us to 
extract a weakly convergent subsequence which we continue to denote by {um}- Let 

Um — >■ M in Hq{Q) weakly . 



LECTURE NOTES: THE GALERKIN METHOD Q 



9 



Step 3: As usual, we define the space of infinitely smooth functions C^(ri) = Viyi). 
Let V £ 'D{Q). Then there exits Vm S Wm such that Vm ~^ v strongly in iJg(ri). In 
fact, we can choose 



(^J Vw • Wwi^ w^. 



Then, by 

(30) / VUm • Vt;™ - A / U,nVm + / U-^m'"m = / fVn 









/ ul^Vm = / 


Jn 


Jn Jn 



Now we pass to the limit, firstly for the linear terms. It is easy that Um u weakly 
in Hq[^) so strongly in L^(r2), Vm ^ v strongly in H^{U,) and L^(0). Thus, 

hm„^oo Vu„ • Vvm = Vw • Vw, 

(31) lim„_>oo jQUmVTn= JqUV, 

limm_>oo /q /Vm = Jq/v- 

Step 4- Finally we pass to the limit in the nonlinear term. 



(32) / U-'v^ uf^{Vra-v)+ / (wf„ - 1t^)w, = A + B 

Jn Jn Jn Jn 



(33) 



< C\Um\l n\Vm - v\i^n 
<CR^\v^-v\i^n- 



\B\ = I /o« - U^)v\ = I J^{Um - U){ul^ + U^U + U^)v\ 

< C\uyn - u|o,n- 

both of which separately go to as to —> oo. Thus, for every v £ I?(ri) 

(34) / Vu-Vv- X UV+ / u^v= / fv, 

Jn Jn Jn Jn 

and since 'D{fl) is dense in HQ{fl), and the above expression is linear in v we 

complete our discussion on existence of solutions. 
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